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ABSTRACT 


In  thia  paper,  we  conaider  the  problem  of  atate  estimation  for 
diacrete  ayatems  with  parameters  which  may  be  switching  within  a finite 
set  of  values.  In  the  general  case  it  is  shown  that  the  optimal  estimator 
requires  a bank  of  elemental  estimators  with  its  number  growing  exponen- 
tially with  time.  For  the  Markov  parameter  case,  it  is  found  that  the  opti- 
mal estimator  requires  only  elemental  estimators  where  N is  the  number 
of  possible  parameter  values. 


I 

I- 


- . - 


1 


1.  Introduction 

In  mo*t  practical  applications  of  recursive  estimation  theory,  there 
are  difficulties  in  obtaining  an  exact  mathematical  model  of  the  physical 
dynamic  process.  The  uncertain  parts  of  the  system  are  sometime  repre- 
sented by  an  unknown  parameter  vector.  When  the  state  estimation  for  this 
type  of  system  has  to  be  carried  out,  the  variations  of  these  parameters  and 
their  identification  play  a critical  role. 

Many  approaches  have  been  proposed  in  attempting  to  perform  state 
estimation  together  with  parameter  identification.  There  is  one  class  of 
adaptive  estimation  scheme  which  calls  for  the  construction  of  a bank  of 
elemental  estimators  with  each  matched  to  a possible  parameter  value  [l|  - 
[7],  The  optimal  state  estimate  is  obtained  via  a weighted  sum  over  the 
elemental  estimates  with  the  a posteriori  hypothesis  probabilities  as 
weighting  factors.  Based  upon  this  idea,  algorithms  for  both  adaptive  esti- 
mation and  control  have  been  designed.  These  algorithms  are  optimum  U 
1)  one  of  the  assumed  model  matches  with  the  physical  process  and  2)  the 
unknown  parameter  is  a constant  vector.  Various  arbitrary  modifications 
have  been  suggested  to  alleviate  the  above  restrictions. 

The  purpose  of  this  paper  is  to  present  the  extension  of  the  above 
adaptive  estimation  scheme  to  the  case  when  the  parameter  vector  is 
assumed  to  vary  within  a finite  number  of  values.  For  a general  parameter 
process  when  the  present  parameter  value  can  depend  on  the  past  history  of 
the  parameter  values,  the  optimum  state  estimate  is  found  to  be  the  weighted 
sum  of  elemental  estimates  obtained  by  estimators  matched  to  all  possible 
parameter  histories.  The  weighting  factor  is  the  a posteriori  hypothesis 
probability  determined  by  1)  residual  prscc«ses  of  all  elemental  estimators 
and  2)  the  conditional  probability  characterising  properties  of  the  parameter 
process.  Since  each  elemental  estimator  has  to  match  to  a given  parameter 
history  and  the  number  of  possible  klatories  grows  with  time,  the  optimal 
estimator  requires  exponentially  growing  memory.  When  the  parameter 
follows  a Markov  process,  1.  e. , the  present  parameter  value  depends  only 
on  the  previous  parameter  value,  this  great  computational  and  memory 
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requirement  it  relaxed*  It  ie  ehown  that  the  required  number  of  elemental 
estimator  stays  at  for  the  Markov  parameter  case  where  N is  the  number 
of  possible  parameter  values.  Since  the  estimator  for  the  Markov  parameter 
allows  the  parameter  to  change  with  time  and  its  computational  requirement 
is  quite  modest  (when  compared  with  the  exponentially  growing  memory 
requirement)*  it  may  be  used  as  a feasible  suboptimal  estimator  design  for 
the  general  time  varying  parameter  estimation  problem. 

There  are  a number  of  potential  application  areas  of  the  above 
proposed  scheme.  For  example,  the  constant  parameter  multiple  elemental 
estimator  algorithm  was  applied  in  the  F-8C  aircraft  real>time  control 
problem  [6].  In  that  application,  the  aerodynamic  constants  were  discre- 
tUed  into  several  sets  of  values.  A bank  of  Kalman  filters  were  constructed 
to  match  each  sSt  of  parameter  values.  The  switching  parameter  algorithm 
discussed  here  will  allow  a more  rapid  switching  among  different  sets  of 
parameters  when  the  true  aerodynamic  constants  have  indeed  changed. 

Another  potential  application  of  this  scheme  it  in  the  Re 'entry  Vehicle  (RV) 
tracking  area  [8]'[10).  A RV  reenters  the  atmosphere  following  a ballistic 
trajectory.  It  may  perform  aerodynamic  maneuvers  at  a medium  altitude 
region  and  return  to  ballistic  at  low  altitude  region.  A detection  scheme 
was  suggestedf  in  [8]  and  [9]  allowing  the  detection  of  a RV  maneuver.  This 
scheme  suffers  from  detection  delay  and  filter  transients  in  the  switch-over  region. 
In  addition,  it  cannot  identify  the  change  to  a trajectory  from  maneuver  to 
ballistic.  Another  solution  is  to  construct  two  filters,  a ballistic  filter  and 
a maneuvering  filter.  If  one  chooses  the  constant  parameter  algorithm,  then 
a large  bias  error  will  develop  in  the  ballistic  filter  when  the  RV  initiates  a 
maneuver*  It  tiierefore  cannot  identify  the  maneuver  quench.  The  proposed 
algorithm  allowing  transition  probabilities  to  exist  between  ballistic  and 
maneuvering  filters  thus  allow  the  rapid  identification  of  a maneuvering  as 
well  as  a ballistic  trajectory. 

The  optimal  estimator  for  continuous  systems  with  continuously 
time-varying  parameters  was  considered  before,  e.g.  see  References  tZ|- 
[4].  A representation  theorem  was  given  in  (2  ] and  [3]  and  the  differential 
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equation  for  the  a posteriori  hypothesis  probability  density  fvmction  was 
given  in  [4].  It  is,  however,  very  difficult  to  derive  the  algorithm  for  the 
discrete  case  by  directly  discretizing  the  results  of  [2]-[4].  The  derivation 
used  in  this  paper  is  that  of  Bayesian  approach  [ll].  Similar  derivations 
were  used  in  [5j  and  [7]  where  the  adaptive  control  problem  was  discussed 
in  [5]  and  a tutorial  treatment  of  the  multiple  elemental  estixnator  approach 
to  adaptive  estimation  was  presented  in  [7]. 

This  paper  is  organised  as  follows.  The  state  estimation  problem 
considered  in  this  paper  is  stated  in  Section  2.  The  optimal  state  estimators 
for  1)  a general  parameter  process  and  2)  a Markov  parameter  process  are 
presented  in  Section  3.  The  time  evolution  of  the  parameter  process  if 
characterized  by  a set  of  hypothesis  processes  which  is  also  discussed  in 
the  Section  3.  The  implementation  of  the  optimal  state  estimator  depends 
upon  the  elemental  estimators.  This  subject  is  briefly  discussed  in  Section 
4.  Derivations  of  the  estimation  algorithms  are  given  in  the  Appendix. 

2*  Problem  Statement 

Consider  the  following  discrete  system  and  measurement  equations. 


x(t+l)  = i^t),  j(t),  u(tj,  £(t)  ) (2. 1) 

*{t+l)  « h(x(t+l),  e(t+D)  (2.2) 


where 


x(t)  is  the  state  vector 

u(t)  is  the  known  control  vector 

£(t)  is  the  measurement  vector 

£(t)  is  the  system  noise  vector 

£(t)  is  the  measurei;neat  noise  vector 

^(t)  is  the  random,  unknown,  and  time-varying  parameter  vector 
t is  the  discrete  time  index 
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The  parameter  vector  ie  restricted  to  take  values  from  a finite  set. 
Define  a finite -dimensional  parameter  vector  set  containing  N distinct 
parameter  vectors,  i.  e, , 

! V = ; i = 1 (2.3) 

The  parameter  may  switch  to  any  parameters  in  at  the  next  discrete 
time,  i.  e. , 


€ R 

q 

when  t ^ T,  i may  or  may  not  be  equal  to  j.  Due  to  this  property,  Y is  called 
a stochastic  jump  parameter.  A similar  parameter  process  was  considered 
earlier  in  a control  design  problem  [ 12], 

Given  the  problem  defined  above,  we  would  like  to  find  the  minimum 
variance  estimator  (true  conditional  mean)  of  the  state 

x(t/t)  = E{x(t)/Z(t)l  (2.4) 

and  the  conditional  covariance  matrix 

E(t/t)  = cov  Ix(t)  ; x(t)/Z(t)l  (2.5) 

where  Z(t)  is  the  set  of  all  past  measurements  and  controls,  i.  e. , 

Z(t)  a (u(0)  , u(l)  u(t-l)  . e(l) a(t)  i (2.6) 

This  is  clearly  a discrete  nonlinear  estimation  problem.  With  (he  parameter 


1 = li 


at 


for 


li 


and 


I = L 


at 


for 
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vector  defined  above,  it  can  be  shown  that  the  optimal  estimator  has  a fixed 
structure.  That  is,  the  optimal  estimate  is  a weighted  sum  of  elemental 
estimates  with  each  matched  to  a possible  parameter  history.  Furthermore, 
when  the  system  becomes  linear  even  though  the  parameter  process  is  still 
related  to  the  state  vector  nonlinearly,  the  optimal  estimates  can  be  computed 
for  a finite  discrete  time  t. 

3.  Problem  Solution 

In  this  section,  we  present  solutions  to  the  described  estimation 
problem  for  i)  a general  parameter  process,  and  2)  a Markov  parameter 
process.  In  order  to  mathematically  characterize  the  time  evolution  of  the 
parameter  process,  we  first  define  a set  of  hypothesis  processes  in  the 
following  subsection. 

3.  I Hypothesis  Pfocesses 

The  parameter  vector  may  switch  to  any  vectors  in  at  the  next 
discrete  time,  the  number  of  parameter  permutation  therefore  grows 
exponentially.  A set  of  indices  is  defined  to  represent  the  time  evoluation 
of  the  parameter  permutation. 

1)  I is  an  index  set  denoting 


I s ( i ; i = I N j 


(3.  1) 


2)  I^  is  a t-tuple  index  set,  i.  e. , 


= {i:i  = i^xi^_jX...xij;i^,...,lj  cl) 


(3.2) 
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Notice  that  I is  the  index  for  perezneter  vectors  in  end  is  the 
index  for  the  permutation  of  the  parameter  vector  from  the  initial  time  to 
time  t.  In  the  following,  two  hypothesis  processes  representing  the  param> 
eter  time  history  are  defined. 

1)  H^(t),  i e 1 : the  hypothesis  that  Y = "local" 

hypothesis  since  it  only  concerns  the  status  of 
Xat  t. 

Z)  i e the  hypothesis  that  a given  history  of  X ior  up 

to  time  t is  true.  This  history  is  indexed  by 
a i e I^.  It  is  a "global"  hypothesis  since  it 
concerns  the  time  history  of  Y.  For  all 
i c 1^,  it  defines  all  possible  Y sequences  for 
up  to  time  t. 

Clearly,  the  global  hypothesis  describes  the  time  evoluation  of  the 
parameter  proceia*  It  is  specified  by  local  hypotheses  at  each  discrete 
time  instance,  i.e. , 

H7(t)  » (H.  (t),H.  (t-l)  . ....  H.  (1)  ) (3.3) 

H H-l  h 

where  i < I| 

i^»  •••• 

i is  determined  by  a given  sequence  of  i^  , . . . , 

In  the  discussions  to  follow,  we  will  frequently  refer  to  the  a 
posteriori  hypothesis  orobabilitv.  It  is  the  probability  of  a given  hypothesis 
being  true  conditioned  upon  the  past  measurements,  i.  e. , 

Pj{t)  • Prob  (the  i-th  hypothesis  is  true  t Z(t))  (3.4) 
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For  atatc 


X (i/t)  - E Pitti  ii 


(3.7) 


£(t/t)  = 


Isl^ 


Xj  (t/t)  = E ( x(t)  / E(t)» 


E^(t/t)  9 cov 


( *(t);  x(t>  / Z{t), 


For  th.  . oortortort  byi»lhe.U  probobUtty 
p(»(trl) 


• P (Hj(l+l)  / 2(»! ) 


(3o9) 


1)  Id,  k clj.  3 « Ixk 

2)  P(H,(.*I)  I Zt*l  ) = P”*-  ^ ’ 

Wa  make  the  following  ratnarkai 
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1)  The  elemental  estimate,  x^(t/t),  is  obtained  by  constructing  a 
minimum  variance  estimator  based  upon  systems  and  measurement  equations 
defined  by  (2. 1)  < (2.2)  with  the  parameter  process  matched  to  the  i-th 
global  hypothesis,  1?^(t). 

2)  The  elemental  estimates,  x^(t/t),  and  covariances,  £^(t/t),  are 
combined  to  obtain  the  optimal  estimate  x (t/t)  and  covariance ^(t/t)  by  using 
a weighted  sum.  The  i-th  weighting  factor,  P^(t),  is  the  a posteriori 
hypothesis  probability  of  the  i'th  global  hypothesis  being  true  conditioned 
upon  all  the  past  measurements  and  controls. 

3)  The  above  equations  are  independent  of  whether  the  system  is 
linear  or  nonlinear.  When  the  system  is  nonlinear,  the  elemental  estimates 
can,  of  course,  only  be  obtained  approximately.  The  problem  of  realization 
will  be  discussed  in  the  next  section. 

4)  The  probability  density  functions  of  (3.9)  are  computed  by 
using  residual  processes  of  elemental  estimators.  That  is 

a)  p(c(t+l)  / Hj(Ul).  !T^(t),  Z(t)  ) 

• the  density  of  the  residual  process  of  the  elemental 
estimator  matching  to  and  H^(t4-1). 

b)  p(a(t+l)  'Z(t)) 

==  L r E p(a(t+l)  /S  (t),  H (t+l).  Z(t)  ) 

mel^  L Ml  ” 

. P(H„(t+l)  / (t),  Z(t)  )|p^(t)  (3.10) 

n m I m 
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5)  The  conditional  hypothesis  probability,  P{H.(t+l)/H^(t),  Z(t)  ), 
represents  the  property  of  the  hypothesis  process.  It  characterizes  the 
evolution  of  y in  R , Notice  that  we  do  not  restrict  the  behavior  of  v 

J-  q - 

variations.  In  the  most  uncertain  situation  such  that  the  parameter  may 
change  to  any  parameters  in  with  equal  probability  one  obtains 

P(Hj(t+l)  /ITj^{t),  Z(t)  ) = foraU  iel  (3.11) 

If  the  parameter  is  a Markov  process,  it  becomes  the  transition  probability 

P{Hj(t+l)  / 1ij^(t),  Z(t)  ) 

= P(Hj(t+l)  / Hj^(t)  ) for  i.  k e I (3.  12) 


6)  Clearly,  the  difficulty  of  implementing  this  estimator  lies  in 
the  fact  that  the  number  of  elemental  estimators  grows  exponentially  with 
time.  The  time  evolution  of  elemental  estimators  for  N = 2 is  shown  In 
Fig.  1.  Notice  that  at  time  t,  the  number  of  elemental  estimators  grows  to 
2*. 

This  difficulty  is  however,  alleviated  when  the  parameter  follows  a 
Markov  process.  It  can  be  shown  that  for  a Markov  parameter  process,  the 
number  of  elemental  estimator  is  limited  to  N^.  This  case  is  discussed  in 
the  next  section. 

3.  3 The  Markov  Parameter  Case 

In  presenting  the  algorithm  for  the  Markov  parameter  case,  we  use 
the  following  simplified  notations: 

^(t/t)  = E [ x{t)  / Hj(t),  Z(t)  1 

^<t/t)  = cov  [ x(t);  x(t)  / Hj(t).  Z(t)  ) 
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k.AtIt-l)  s E [ x(t)/Hj(t),  H.(t-1)»  Z(t-l)  1 = the  predicted  state 

K..(t/t)  = E [ x{t)/Hj(t),  H.(t-l),  Z(t)  ] = the  updated  state 

Pj(t)  = Prob  (H.(t)  is  true  / Z(t)  ) 

Py  = Prob  (Hj(t)  is  true  / Hj(t-l)  ) 

= the  transition  probability 

Py(t)  = P(a(t)  / Hj(t),  H^(t-l),  Z(t-l)  ) 

= the  residual  density  of  the  (i,  j)«th  elemental  estimator 

We  now  proceed  to  state  the  estimator.  The  derivation  is  included 
in  the  Appendix. 

1)  For  state  estimate  and  covariance  calculations: 

1. 1)  At  time  t-1,  we  have 

Xj(t-l  / t-1),  Sj(t-1  f t-1),  Pj(t-l);  for  i = 1,  ...,  N 

1.2)  Compute 

Xy(t/t-l),  Ey(t/t-l);  fori,j  = 1 N 

2 

using  N state  and  covariance  predictors. 

1.3)  Compute 

&y(t/t),  |y(t/t){  £ori,j  = 1,  ...,N 

2 

using  N state  and  covariance  updators  and  the  new  measurement  £(t). 


1.4)  Compute  x^  (t/t)  and  E.(t/t)  for  i=l,  . . . , N using 


x.(t/t)  = D x.,(t/t)  P (H.(t-1)/H.(t),  Z(t) 

-i  j=l  -y  J i 


(3.  13) 


2i<t/t)  = j£j  P (H^(t-1)  / H.(t),  Z(t)  ) 


(3.  14) 


• C Sy  (t/t)  + (|jj(t/t)  - x.(t/t)  ) (^^(t/t)  - x.(t/t)  )'^] 


where 


p(Hj(t-i)/Hj(t),  z(t))  « — 

I Pij(yPijPj(t-i) 


(3.15) 


I,  5)  The  minimum  variance  (true  conditional  mean)  state  estimate  x (t/t) 
and  covariance  Z (t/t)  are  obtained  by 


P^{t)&j(t/t) 


(3.  16) 


E(t/t)  » Pi(t)[£i(t/t)  + (^(t/t)  - x(t/t)  ) (x^(t/t)  - x(t/t)  (3.  17) 


The  above  completes  one  cycle  of  the  state  estimate  and  covariance 
computation. 


2)  For  the  > posteriori  hypothesis  probability  calculations 


N 


Pj(t) 


E Py(t)Py  Pjlt-l) 

^ 


(3.  18) 


We  make  the  following  remarks; 

2 

1)  The  above  algo:*thm  requires  implementing  N elemental 
estimators.  If  the  elemental  estimator  is  a minimum  variance  estimator, 
then  the  state  estimate  x(t/t)  is  optimum  in  the  minimum  variance  sense. 

2)  Equation  (3. 18)  may  be  re-written  in  a matrix  form,  let 

g^(t)  bo  anNxl  column  vector  consisting  of  all  a posteriori 
local  hypothesis  probabilities  at  time  t 


p(Hj(t)  / Z(t)  ) 


p<Hpj(t)  / Z(t)  ) 


and  let 


S(t+l/t)  be  an  (NxN) matrix  with  the  (i.  j)-th  element  Sy  being 
equal  to  the  product  of  the  residual  density  of  the  elemental 
estimator  matched  to  H|(t-tl)  and  Hj(t)  and  the  probability 
of  H|(t4>l)  being  true  conditional  upon  Hj(t). 
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»,.(t)  * [ P (*(t+l)/H.(t+l),  H (t),  Z(t)  ) P(H.(t+l)  /H.(t)  ) ] 

Ij  J J 

Then 

q(t+l)  = S(t+1  /t)  q{t)  (3.19) 

p(*(t+l)  / Z(t)  ) 

The  time  evolution  of  the  hypothesis  process  for  a Markov  parameter 
process  is  illustrated  in  Fig.  2 for  N = 2.  A detailed  flow  chart  illustrating 
the  state  estimation  process  for  N = 2 is  shown  in  Fig.  3. 

A special  case  of  the  above  is  when  the  parameter  is  known  to  be 
time  invariant.  Under  this  condition,  the  above  estimator  is  reduced  to  the 
estimator  derived  by  Magill  [l].  This  can  be  obtained  by  substituting 

!1  when  i = j 

(3.20) 

0 otherwise 


into  the  estimator  equations. 

4.  Elemental  Estimator  Implementation 

The  significance  of  tho  estimator  presented  in  the  previous  section 
is  that  the  estimator  structure  is  the  same  for  both  linear  and  nonlinear 
systems.  This  conclusion  was  also  found  in  the  continuous  case  [2]  - {4]. 
The  estimator  realisation  therefore  depends  on:  1)  the  realisation  of  the 
elemental  estimator  and  2)  the  practicality  of  constructing  a large  number  of 
elemental  estimators.  Three  cases  can  be  considered. 


a)  General  Case 

For  the  system  and  measurement  equations  considered  in  equations 
(2.  1)  - (2.2),  x^(t/t)  and  E^(t/t)  cannot  be  computed  exactly.  Suboptimal 
nonlinear  filters  such  as  the  extended  Kalman  filter  [13]  or  the  second  order 
filter  [l4l  must  be  used.  These  filters  have  found  many  practical  applica- 
tions. They  can  be  applied  to  approximate  the  optimal  estimators. 

b)  Linear  System  Case 

When  the  system  is  linear  and  noise  vectors  are  additive,  the 
optimal  estimate  can  be  computed  exactly.  In  this  case,  the  elemental 
estimator  is  constructed  by  using  the  discrete  Kalman  filter.  In  the 
general  case,  the  number  of  Kalman  filters  grows  exponentially  with  time. 

For  the  Markov  parameter  case,  the  number  of  Kalman  filters  is  N^. 

c)  Linear  System  and  Constant  Parameter  Case 

This  is  the  case  considered  by  Magill  [l].  The  estimator  presented 
in  this  paper  can  be  reduced  to  the  Magill' s estimator  by  properly  setting 
tho  conditional  probabilities. 

5.  Discussion  and  Conclusions 

In  this  paper,  we  have  presented  the  optimal  estimator  for  discrete 
systems  with  finite-valued  switching  parameters.  For  a general  parameter 
^pj^bcess  in  which  the  present  parameter  value  can  depend  on  the  past  history 
"j(S|:ihe  parameter  values,  the  memory  requirement  of  the  estimator  grows 
; «)s^nentiaUy  with  time.  When  the  present  parameter  value  depends  only  on 
V :&ii  previous  parameter  value  and  this  dependence  can  be  characterised  by 
"tlft  transition  probability,  the  required  number  of  elemental  estimator  is 
Ibhnd  to  be  equal  to  N'^  where  N is  the  number  of  possible  parameter  vectors. 
,y^^ith  this  modest  memory  requirement,  this  algorithm  is  felt  to  be  feasible 
-Jfby  suboptimal  estimator  design  for  the  general  time-varying  parameter 
r wiibiimation  problem. 

. ...  V \ 

' ' ' 
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APPENDIX  DERIVATIONS 


A.  1 Derivation  of  Equations  (3.7)  and  (3.8) 

This  derivation  involves  a straightforward  application  of  the  defini- 
tions of  x(t/t)  and£(t/t)  and 


p^(t)/Z(t))  s £ P.(t)  p(x(t)/S.(t),  Z(t)  ) 

ie:,  ‘ ‘ 

The  details  are  omitted  here* 


(A.  1) 


A.  2 Derivation  of  Equation  (3.  9) 

Using  the  conditional  probability  relation  yields 


P^(Hl)  * P(H^(t+l) /Bj^(t),  Z(t+1)  ) P(Bj^(t)/Z(t+l)  ) 


where  lei  and  kc  I * 

Using  the  Bayes'  rule  one  obtains 


P(Hj(t+l)/Bj^(t),  Z(t+l)  ) 


(A.  2) 


p(e(t+l)/Hj(t+l),  Rj^(t).  Z(t)  ) 
p(i(Hl)/Bj^(t),  Z(t)  ) 


P(Hj(t+l)/Rj^(t),  Z(t)  ) (A.  3) 


and 


P(R^(t)/Z(t+l)  ) 


p(a(t+l)  /R.  (t),  Z(t)  ) 

* ”pg(ff  fTTYgn : — (a.4) 
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Substituting  (A.  3)  and  (A. 4)  into  (A. 2)  one  obtains  (3*9).  This  completes 
the  derivation. 


A.  3 


Derivation  of  Equations  (3*  13)«  (3. 14),  and  (3. 15) 
Using  the  definitions  of  &^(t/t)  and  £^(t/t),  i*  e. 


>.  * 


i|(t/t)  » J x(t)  P(x(t)  /Hj(t),  Z(t)  ) dx 


(A.  5) 


£i(t/t)  » J (x(t)  - ^(t/t)  ) (x(t)  - Xj(t/t)  P^(t)  /Hj(t),  Z(t)  ) dx  (A. 6) 


and  the  relation 


p(x{t)/H^(t),  Z(t)  ) 

* £ P(*(t)/Kj(t),  H^(t-l),  Z(t)  ) P(Hj(t-l)/Hj(t),  Z(t)  ) (A.  7) 

equations  (3. 13)  and  (3. 14)  follow  immediately.  It  remains  to  show  equation 
(3*  15).  Using  the  coiktitional  probability  and  the  Bayes'  rule  yield 

P(Hj(t-l)/H^(t),  Z(t)  ) 

P(H,(t-l),  Hj(t)  / Z(t)  ) 

" 


(A.  8) 


and 


P(H^(t-l),  Hj(t)/Z(t)  ) 

p(«(t)/Hj(t).  H.(t-l),  Z(t-l)  ) 
• 


P(Hj(t)/Hj(t-l))Pj(t-l)  (A.  9) 
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Notice  that  p(s(t)  / Z(t-1)  ) is  computed  by  using 

N N 

p(z{t)/Z(t-D)  = £ p(z{t)/H^(t),H^(t*-«l),Z(t-l))P(Hj(t)/Hj.(t-l))Pj.{t-l) 


(A.  10) 


Substituting  (A.  9)  and  (A*  10)  into  (A.  8)  and  using  (3. 18)  one  obtains  (3. 15). 
This  completes  the  derivation. 

A.  4 Derivation  of  Equations  (3, 16)  and  (3*  17) 

This  derivation  involves  a straightforward  application  of  the 
definitions  of  i (t/t)  and  Z (t/t)  and 


p^(t)/Z(t))  s Pj(t)P(*(t)/Hj(t),  Z(t) 


The  details  are  omitted  here. 


and 


P(H^(t-l)/2(t)  ) 


p(*(t)  /H^(t-1),  Z(t-1)  ) 
p(i'(t)7ZTt--m — 


P{H^(t-l)/Z(t-l)  ) 


(A.  14) 


Substituting  (A,  13)  and  (A.  14)  into  (A.  13)  and  using  (A.  10)  one  obtains  (3.  18). 
This  completes  the  derivation. 
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Evolution  of  Elemental  Estimates  for  N=2 


Figure  3 State  Estimator  for  Markov  Parameters  with  N»2 
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